Skip to content

bugfix: align DeepSeek V4 MTP hidden state flow on NPU.#1981

Merged
DongheJin merged 1 commit into
xLLM-AI:mainfrom
DongheJin:fix/npu-dsv4-mtp-hidden-state
Jul 24, 2026
Merged

bugfix: align DeepSeek V4 MTP hidden state flow on NPU.#1981
DongheJin merged 1 commit into
xLLM-AI:mainfrom
DongheJin:fix/npu-dsv4-mtp-hidden-state

Conversation

@DongheJin

Copy link
Copy Markdown
Collaborator

Description

Related Issues

Change Type

  • Bug fix
  • New feature
  • Performance improvement
  • Refactor
  • Documentation
  • Test
  • Build or CI

Pull Request Checklist

Thank you for contributing to xLLM. Before requesting review, please make sure the following items are complete.

PR Title and Commit Messages

  • The PR title and each commit message follow the xLLM commit format: <type>: <subject>.

Allowed types: feat, bugfix, docs, test, refactor, chore, style, revert, perf, model, build, release.
The subject should use clear English, start with a verb, include at least 4 words, and end with ..

Pre-commit Checks

  • I have installed pre-commit by running pip install pre-commit or an equivalent command.
  • I have installed the hooks with pre-commit install.
  • I have run pre-commit run --all-files and fixed any reported issues.

If you are unsure how to set up pre-commit, see the pre-commit documentation.

Self Review

  • I have self-reviewed the code according to .agents/skills/code-review/references/custom-code-style.md, especially code written or assisted by AI.
  • I have rebased this PR onto the latest main branch.

Build and Test Coverage

  • Tests have been added or updated as needed.
  • CUDA: python setup.py build test has passed on a CUDA machine.
  • NPU: python setup.py build test has passed on an NPU machine.
  • MLU: python setup.py build test has passed on an MLU machine.

Reviewer Notes

@DongheJin DongheJin changed the title fix: align DeepSeek V4 MTP hidden state flow on NPU. bugfix: align DeepSeek V4 MTP hidden state flow on NPU. Jul 20, 2026
JimHsiung
JimHsiung previously approved these changes Jul 20, 2026
Kang-Meng
Kang-Meng previously approved these changes Jul 20, 2026
@DongheJin
DongheJin dismissed stale reviews from Kang-Meng and JimHsiung via 3656892 July 24, 2026 08:14
@DongheJin
DongheJin force-pushed the fix/npu-dsv4-mtp-hidden-state branch from e7656f5 to 3656892 Compare July 24, 2026 08:14
@DongheJin
DongheJin merged commit 0c4391d into xLLM-AI:main Jul 24, 2026
7 of 37 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants